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State Amplification Subject To Masking Constraints 

O. Ozan Koyluoglu, Rajiv Soundararajan, and Sriram Vishwanath 



Abstract 

This paper considers a state dependent channel with one transmitter, Alice, and two receivers, Bob and Eve. The problem is 
to effectively convey ("amplify") the channel state sequence to Bob while "masking" it from Eve. The extent to which the state 
sequence cannot be masked from Eve is referred to as leakage. This can be viewed as a secrecy problem, where we desire that 
the channel state itself be minimally leaked to Eve while being communicated to Bob. The paper is aimed at characterizing the 
trade-off region between amplification and leakage rates for such a system. 

An achievable coding scheme is presented, wherein the transmitter transmits a partial state information over the channel to 
facilitate the amplification process. For the case when Bob observes a stronger signal than Eve, the achievable coding scheme is 
enhanced with secure refinement. 

Outer bounds on the trade-off region are also derived, and used in characterizing some special case results. In particular, 
C^l ■ the optimal amplification-leakage rate difference, called as differential amplification capacity, is characterized for the reversely 

degraded discrete memoryless channel, the degraded binary, and the degraded Gaussian channels. In addition, for the degraded 
' Gaussian model, the extremal corner points of the trade-off region are characterized, and the gap between the outer bound and 

achievable rate-regions is shown to be less than half a bit for a wide set of channel parameters. 
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I. Introduction 



Information-theoretic secrecy analysis is now a very well established field (see, e.g., Special Issue on Information Theoretic 
Security, IEEE Trans. Inf. Theory, June 2008 and references therein). A vast body of this literature is focused on secrecy metrics 
and information-theoretic secrecy guarantees for messages from passive and active adversaries. Although information-theoretic 
. secrecy is of considerable interest, there is still a disconnect between the domain of information-theoretic secrecy and that of 
computational secrecy methodologies in cryptography. This disconnect, along with conservative rate guarantees, have meant 
that information-theoretic secrecy has found only a limited number of applications. 

In recent years, a bridge between cryptography and information theory has emerged in the form of channel state-dependent 
£^ key generation |fl~), El, E), ID- In this line of work, a state dependent channel (such as the wireless channel) is considered, 
and a function of this state is intended to be a 'shared secret' between the legitimate transmitter (Alice) and legitimate receiver 
, (Bob) while aiming to keep the eavesdropper (Eve) as much in the dark as possible. We intend to provide information-theoretic 
■^J" ' guarantees to the extent to which such a shared secret can be realized for our system model. Once obtained, this shared secret 
, can now be employed to seed numerous symmetric key cryptosy stems J3), (6). Another relevant setting where our results 
will be of significant interest is in cognitive radio systems Q, (8), J9j> iflOl . ifTTl . lfT2l . |[T3l . In this scenario, the cognitive 
encoder (Alice) facilitates the secure communication of the primary signal (the state sequence of the channel) by amplifying 
the signal at the primary receiver (Bob) while masking it from the eavesdropper (Eve). More generally, this setting belongs 
to user cooperation or relaying architectures that increase/decrease the security of the communication systems lfl4l . fl5l . fl6l . 

El. 

In this paper, we consider a state dependent broadcast channel model with two users, and consider the question of to what 
1 extent the state of the channel can be amplified at the receiver (Bob) and masked from the other receiver (called as Eve). In 
the best case, the state(s) seen by Bob and Eve will be completely different (independent). However, we consider what might 
be a pessimistic model where there is a single channel state defining the channel for both Bob and Eve. Moreover, the entire 
channel state sequence is presumed to be known non-causally to the transmitter (a Gel'fand-Pinsker-style assumption [ 181). 
The only manner in which an asymmetry can be affected between Bob and Eve is by the encoding used at the transmitter. For 
such a system, we aim to characterize the trade-off between the "amplification"-rate at which the legitimate pair can operate 
and the "leakage"-rate to the eavesdropper. In essence, as long as there is a non-trivial difference between the two, this can 
be used to develop shared keys and enable cryptographic algorithms. More specifically, we define the measure differential 
amplification capacity as the maximal knowledge difference regarding the state of the channel between Bob and Eve. This 
metric transforms the two-dimensional amplification-leakage trade-off to a single dimension, and can be viewed as a bound on 
the secrecy that can be leveraged from the channel state knowledge difference. In this form, the problem at hand is very much 
related to the generation of secrecy using sources and channels. Here, not only the source in the model is the channel state 
(different from the models studied in |fl9l , |20l ), but also it is non-trivially combined with the encoded signals of Alice (via 
the state dependent channel) to produce the observations at Bob and Eve. Hence, our formulation can be closely associated 
with the problem of secret key agreement over state dependent channels lED . El . In such problems, one is interested in the 

The authors are with the Wireless Networking and Communications Group, Department of Electrical and Computer Engineering, The University of Texas, 
Austin, TX 78712. Email: ozan@austin.utexas.edu, rajivs@utexas.edu, sriram@austin.utexas.edu. 
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IL in September 2011. 
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^l" n , R a < ±I(S n ;Y n ) 

Fig. 1. The system model for amplification subject to masking problem. 

design of coding strategies that allow an agreement of secure bits between the legitimate users utilizing the state dependent 
channel. For example, sending secure bits over the channel will increase the secret key rate l22l . Il23l . l24l . On the other 
hand, the problem studied in this work, when specialized to the differential amplification metric, considers only the channel 
state knowledge difference and provides a bound on the secret bits that can be extracted only from the channel state (QJ, J2), 
0, In general, we are not only interested in the knowledge difference, but also in the entire rate trade-off region, which 
constitutes the main focus of this paper. 
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A. Problem Statement 

Consider a discrete memoryless channel given by p(y, z\x, s), where x £ X is the channel input, s £ S is the channel state, 
and (y, z) £ (y x Z) is the channel output, with y corresponding to the legitimate receiver (Bob) and z the eavesdropper 
(Eve). The channel is memoryless in the sense that 

n 

p(Y n = y", Z n = z n \X n = x n , S n = s n ) = l[[ P (y(i),z(i)\x(i), (1) 

»=x 

and the state sequence is independent and identically distributed (i.i.d.) according to a probability distribution indicated by 
p(s). It is assumed that the channel state sequence is non-causally known at the transmitter. (The system model is depicted in 
Fig ED) 

The task of the encoder is to "amplify" the state sequence at Bob (channel output Y") and to "mask" the state sequence 
from Eve (Z n ). Formally, we measure the former by the state amplification rate R a and the latter as the state leakage rate Ri. 
We say (R a ,Ri) is achievable, if for any given e > 0, 

-I(S n ;Y n )>R a -e (2) 
n 

-I(S n ;Z n ) < Ri+e (3) 
n 

for sufficiently large n. The problem is to characterize all achievable {R a ,Ri) pairs, which we denote by the trade-off region 
C. 

The performance of the encoder is also quantified by measuring the difference between the achievable amplification and 
leakage rates. The differential amplification rate Rd is said to be achievable if Rd — R a — Ri for some (R a ,Ri) £ C. The 
maximum value of the differential amplification rate is called as the differential amplification capacity, denoted by Cd, where 

C d = sup R a -Ri. (4) 

(R a ,Ri)ec 

Note that this quantity is important for applications like key agreement from the state of the channel, as this difference measures 
the knowledge difference between the two receivers regarding the state of the channel. 
A cost constraint may also be imposed on the channel input with 

i]TE{c(X«)}<C, (5) 

i=l 

where c : X — > IR + defines the cost per input letter and the expectation is over the distribution of the channel input. In this 
scenario, we say (R a ,Ri) is achievable under the cost function c(.) and cost C, if (OJ, OJ, and (|5]i are satisfied in the limit 
of large n. (We use this constraint for the Gaussian channel, where the cost is the average transmitted power.) 
Remark: One can say that the equivocation rate A; is achievable, if the signaling scheme satisfies 

A; < —H(S n \Z") + e, (6) 
n 
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and, correspondingly consider the achievable (R a , A;) pairs. Hence, the problem can be re-stated in terms of equivocation rate, 
where we seek to characterize all achievable (R a , A;) pairs in the limit of large n. Since both the equivocation and leakage 
rate notions characterize the same trade-off, both notions can be used interchangeably. 

B. Related work, summary of results, and organization 

The problem of communication over state dependent channels is studied by Gel'fand and Pinsker lfT8"l . where a message 
has to be reliably transmitted over the channel with non-causal state knowledge at the transmitter. The Gaussian version of the 
problem is solved in (25] through the famous dirty paper coding scheme. While the wiretap channel is introduced and solved 
in ll26l . these results are extended to a broadcast setting in [27]. The problem of sending secure messages over state dependent 
wiretap channels is studied in l23l . l24l . 

On the other hand, the problems of state amplification and state masking are individually solved in 11281 . |29"1 , l30l for 
point-to-point channels. Both l28l . 11291 and 1301 consider the problem of reliable transmission of messages in addition to 
state amplification and state masking respectively. In this paper, we consider the problem of amplifying the state to a desired 
receiver while trying to minimize the leakage (or mask the state) to the eavesdropper. 

We note that, if we set R a — in our problem definition, it reduces to the state masking problem as studied in ll30l . In 
other words, 

Ra = (7) 

Ri = min I(S;Z) (8) 

p(x\s) s.t. E{c(X)}<C 

can be shown to be achievable 1301 . Also, when Ri > H(S), the problem reduces to a state amplification problem ||29l , and 
one can achieve the following rate pair. 

R a = xmn{H(S), max I(X,S;Y)} (9) 

p(x\a) 

Ri > H(S) (10) 

These represent two extremes of the trade-off region between the amplification and masking rates. In this paper, we aim at 
developing an understanding of this trade-off region through achievable regions and outer bounds, and characterizing special 
cases when they match. Our main results can be summarized as: 

• Achievable Regions: Our achievability arguments are based on enumerating typical state sequences using two indices, and 
sending one of the indices over the channel. Towards this end, we construct a codebook corresponding to the codeword 
carrying this index (denoted by U n ) in such a way that reliable communication can be achieved over the state-dependent 
channel. Subsequently, we derive expressions for achievable amplification and leakage rates by determining single-letter 
bounds on —I(S n ; Y n ) and —I(S n ; Z n ) respectively, and the achievable region is established over the input probability 
distributions p(u,x\s). The bounds show that the rate of the message index not only amplifies the R a , but also increases 
the leakage Ri, thereby establishing a trade-off for implementation. 

• Secure Refinement: We also show that it is possible to extend the proposed region with secure refinement when Bob 
observes a "stronger" channel than Eve. In precise terms, this corresponds to instances of p(u, x\s) satisfying I(U; Y) > 
I(U; Z). Note that a channel is said to have a less noisy structure if I(U ; Y) > I(U; Z) for all input probability 
distributions OTl . 11321 . We find that the utilization of the notion of secure refinement approach is critical to such channels, 
and we show that the leakage due to transmission of the message can be minimized by securing (a part of) the message. 

• Special Classes of Channels: Our outer bound arguments are based on upper bounding ^-I(3 n ; Y n ) and lower bounding 
^I(S n ; Z n ). The achievable schemes and outer bounds presented are used to establish optimality results for a class of 
channels. In particular, we show that the proposed scheme achieves the optimal differential amplification capacity (i.e., 
the maximum value of R a — Ri over the set of achievable (R a ,Ri) pairs) for the reversely degraded discrete memoryless 
channel (DMC), the degraded binary channel, and the degraded Gaussian channel. 

• Gaussian Channels: We characterize the corner points of the region for the degraded Gaussian channel. In this scenario, 
we further bound the gap between achievable and converse regions, and show the following: Let us denote the message 
capacity of Bob's channel as Cb — \ log(l + SNR^) and that of Eve's channel as C e = ^ log(l + SNR e ), where SNR& 
(SNR e ) is the signal-to-noise ratio of Bob (respectively, Eve). Then, for any given leakage rate Ri, the gap between the 
upper and lower bounds on the amplification rate R a is bounded by Cb- Similarly, for any given amplification rate R a , 
the achievable leakage rate is within C e of the lower bound on i?;. In particular, the corresponding gaps are within half 
a bit when SNR b < 1 and SNR e < 1 respectively. 

The rest of the paper is organized as follows. Section [TT] presents our main results, where we provide our proposed coding 
schemes and outer bounding arguments. Section UTU provides optimality discussions and numerical results for special classes 
of DMCs including the reversely degraded channel, modulo additive binary channel model, and the memory with defective 
cells model. The Gaussian channel model is considered in Section [TV] along with corresponding optimality results. Finally, we 
conclude the paper in Section |V] The proofs are collected in Appendices to improve the flow of the paper. 
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II. Main Results 

A. Achievable Regions 

We have the following propositions for any given p(s) and the channel p(y, z\x, s). 

1 ) State sequence covering: The scheme presented below is based on communicating a covering of the state sequence while 
ensuring that the covering is decodable at Bob. We have the following result. 

Proposition 1: Let 7Z 1 be the closure of the union of all (R a ,Ri) pairs satisfying 

R a < I(S;Y,U) 
Ri > mm {I(S;Z,U),I(U,S;Z)} 
< I(U;Y)-I(U;S), 

over all distributions p(u,x\s). Then, 7Z 1 C C. 

Proof: See Appendix lAl ■ 
We note that, provided I(U; Y) — I(U; S) > 0, the covering codeword can be decoded at Bob. Then, the state uncertainty 
can be reduced from H(S) to H(S\Y,U) by listing S n sequences that are jointly typical with (U n ,Y n ). This will give rise 
to the expression I(S; Y, U), as presented in the proposition. (Leakage expressions follow by a similar argument, where U n 
sequence is added to the expression -^I(S n ; Z n ) to derive the achievable leakage expressions.) 

2) State enhanced messaging: In order to achieve a better rate region, the encoder can send a message over the state 
dependent channel, where the message carries partial information about the state sequence. The corresponding achievable 
region is given by the following result. 

Proposition 2: Let 1Z 2 be the closure of the union of all (R a ,Ri) pairs satisfying 

R a < xmn{H(S),I(U,S;Y)} 
Ri > I(U,S;Z) 
< I(U;Y)-I(U;S), 

over all distributions p(u,x\s). Then, 1Z 2 C C. 

Proof: See Appendix IBl ■ 

The achievable rate region can be interpreted as follows: The rate I(U; Y) — I(U; S) corresponds to the Gel'fand-Pinsker 
message rate that can be reliably communicated over the channel. As long as this rate is positive for a given input probability 
distribution, the codeword U n can be reliably communicated over the channel. Bob can decode U n from Y n by employing a 
jointly-typical decoder. Subsequently, the state uncertainty can be reduced from H(S) to H(S\Y, U) by listing S n sequences 
that are jointly typical with (U n , Y n ), Further, the rate I(U ; Y) — I(U ; S) provides an additional refinement to the uncertainty, 
which together with I(S;Y, U) sums to I(U,S;Y). (See also J29), where the authors show that it is possible to interpret 
this scheme as a source coding method with Wyner-Ziv coding 11331 .') The analysis of Ri follows by analyzing an upper- 
bound on the leakage rate by adding the codeword sequence to the expression, ^I(S n ; Z n ) < ^I(U n , S n ; Z n ), which can be 
single-letterized as given in Appendix 151 

We observe that the leakage expression can be enhanced when I(U; Z) > I(U ; Y), and this is detailed in the following 
proposition. 

Proposition 3: For all input distributions p(u, x\s) that satisfy I(U; Z) > I(U; Y). Ri in Proposition can be bounded as 

Ri>I(S;Z, U) + R u , 

for some R u < min{/([/; Y) - I(U; S),H(S\U, Y)}, while R a < I(S; Y, U) + R u . In particular, for R u = min{/([7; Y) - 
I(U;S),H(S\U,Y)}, R a < mm{H(S),I(U, S;Y)}, and 

Ri > min{/(5; Z, U) + I(U; Y) - I(U; S) = I(U, S; Z) - [I(U; Z) - I(U; Y)} , 
H(S)-[H(S\Z, U)-H(S\Y,U)}}. 

Thus, Proposition [3] can be enhanced for those input distributions satisfying I(U; Z) > I(U; Y). 

Proof: (Sketch of the proof) The requirement of I(U; Z) > I(U ; Y) enables the decodability of U n at Eve. Then, using 
arguments similar to those used for the amplification bound in the proof of Proposition [3] (and upper bounding the inequalities 
from (l66l l to ( F74l > by reversing the ones given in d75l l to (f78ll). we obtain the Ri bound as 

R t >I(S;Z,U) + R U . (11) 

Further, by choosing R u < min{I(U; Y) — I(U; S), H(S\U, Y)} we have the desired result. ■ 
The three results above (Propositions Q] [3j and [3]) is combined in the following theorem. 
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Theorem 4: Let 7Z 3 be the closure of the union of all (R a ,Ri) pairs satisfying 

R a < I(S;Y,U) + R U 

Ri > min {l(U,S;Z),I(S;Z,U) + Ru} 

Ru < mm{I(U;Y)-I(U;S),H(S\Y,U)}, 

over all distributions p(u, x\s) satisfying I(U ; Y) > I(U; S). Then, 1Z 3 C C. 

Remarkably, this representation also shows that the covering strategy is a special case of the state enhanced messaging 
approach (when R u = is chosen). We also note that, in the region above, increasing R u will not only increase the amplification 
rate but will also increase the leakage rate. Thus, for some scenarios, implementing only the covering scheme might be 
advantageous. Further implications of this observation on the amplification-leakage region is discussed in Section UlI-AI 

3) Secure refinement: Consider all input distributions p(u,x\s) satisfying I(U;Y) > I{U\Z). For such distributions, it is 
possible to send refinement information securely over the channel. This way, the leakage increase due to refinement index is 
decreased as the security of the index will lower the corresponding leakage rate achieved at Eve compared to the non-secured 
case. 

Theorem 5: Let 1Z A be the closure of the union of all (R a ,Ri) pairs satisfying 

R a < I(S;Y,U) + R U 

R t > mm{l(U,S]Z),I(S-,Z,U) + mia{R u ,[I(U;Z)-I(U-,S)] + }} 
R u < min{I{U;Y)-I(U;S),H(S\Y,U)} 

over all distributions p(u, x\s) satisfying I(U\ Y) > I(U; S) and I(U; Y) > I(U; Z). Then, K 4 C C. 

Proof: See Appendix [C] ■ 

Comparing this region with that presented in Proposition [3] and Theorem 2J we observe that the leakage rate is decreased 
when the refinement is secured from Eve. 

Note that, when I(U : Z) > I(U; S), the analysis given in Appendix ICl for the region above, counts the part of the message 
with rate [I(U; Z) — I(U; S)] + as leakage (as this part is not secured and still being used as a message relevant to state). In 
other words, one can view the codewords as U n (W u , W' u , W%) with rates R u = I(U; Y) - I(U; Z), R' u = I(U; Z) - I(U\ S), 
R" = I(U ; S), where W u is secured refinement and W' u is common refinement that is not only used at Bob, but also is leaked 
to Eve in the analysis. By modifying the coding scheme, one can utilize only the secure rate as the refinement (i.e., only W u 
carries information regarding S n ). With such an approach, it is possible to enhance the leakage given in Theorem [5] (although 
at the cost of a reduction in the amplification rate) as given in the following proposition. 

Proposition 6: The region of the union of all (R a ,Ri) pairs satisfying 

R a < I(S;Y,U) + R U 

Ri > mhi{I{U,S;Z),I(S;Z,U)} 

Ru < mm{I{U;Y)-I{U;Z),H(S\Y,U)} 

for the input distributions satisfying I(U ; Y) > I(U; Z) > I(U ; S) is achievable. 

Proof: (Sketch of the proof) Generate U n (W u , W^W^) codewords with < = I(U; S) and R' u = I(U; Z) - I(U; S) 
for the case of I(U ; Z) > I(U; S). W u carries information regarding the state, W' u is randomly chosen, and W." is chosen to 
find an index I such that u n (w u ,w' u , I) is jointly typical with s n (w u ,w r ). Then, along the lines of the proof of Proposition [5] 
we obtain the result above. ■ 

Combining Proposition [6] with the case I{U\ Z) < I(U; S) of Theorem [5] (see Appendix ICb, we obtain the following. 

Theorem 7: Let TZ 5 be the closure of the union of all (R a ,Ri) pairs satisfying 

Ra < I{S;Y,U) + R U 

Ri > xmn{I(U,S;Z),I(S;Z,U)} 

Ru < xmn{l{U;Y)-masi{I(U;S),I(U;Z)},H(S\Y,U)} 

over all distributions p(u, x\s) satisfying I(U ; Y) > I(U; S) Then, 1Z 5 C C. 

Note that, the amplification rate that can be obtained with such an approach is lower than the previous case (Theorem [5]), 
as the message rate R u < I(U; Y) - J (77; Z) < I(U; Y) - I(U; S) if I(U; Z) > I(U; S). Therefore, the improvement on the 
leakage expression compared to Theorem [5] is obtained with a degradation on the amplification rate. 

B. Outer Bounds 

We now derive upper bounds on R a and lower (upper) bounds on Ri (respectively, on A/). 
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Proposition 8: If (R a ,Ri) is achievable, then (R a ,Ri) e TZ^, where 

p(tt,a:|s) 

satisfying 

i? a < min{i?(5),/(X,5;r)} 
Ri > I(S;Z,U) 
< I{U;Z)-I(U;S), 

for any given p(it, x\s). 

Proof: See Appendix ID1 ■ 
We now provide an outer bound for the degraded channel p(y, z\x, s) = p(y\x, s)p(z\y) using the result above. 
Proposition 9: If the channel satisfies p(y, z\x, s) = p(y\x, s)p(z\y) and if (R a ,Ri) is achievable, then (R a ,Ri) £ V? a , 
where 

K = U ( R ^ R i) 

p(u,x\s) 

satisfying 

R a < min{H(S),I(X,S;Y)} 

R l > I{S;Z,U) 

Ra-Ri < I{X,S;Y\Z) 

< I(U;Y)-I(U;S), 

for any given p(u, x\s). 

Proof: See Appendix [E] ■ 



III. Special discrete memoryless channel models 

A. Reversely degraded DMCs 

We say that the channel is reversely degraded if (X, S) —> Z — >• Y forms a Markov Chain. Note that, this corresponds to a 
stronger channel seen by Eve compared to that of Bob. We have the following result for this set of channels. 
Theorem 10: The optimal differential amplification rate for reversely degraded DMCs is given by 

C d = max I(S; Y) - I(S; Z) 

p(x\s) 

Proof: Achievability of the stated difference follows from Proposition Q] by substituting U = <f>. We provide the converse 
in Appendix IH ■ 
Note that coding can not improve this difference as the channel is reversely degraded. Thus, coding might help to increase 
R a at the expense of decreasing R a — Ri for the reversely degraded scenario. In particular, the region provided by Proposition^ 
which is an enhancement over that of Proposition [3] is achievable for the reversely degraded scenario. And, in the region stated 
in Proposition [3] R a vs. R a — Ri can be traded-off using different input distributions. (U = <f> case will correspond to the 
maximum R a — Ri, and achieve Cd-) 



B. Modulo additive binary model 
Consider the channels given by 

Y(i) = X(i)®S(i)®N(i) 

Z(i) = X(i)®S(i)®N z (i), (12) 

where the state and noise distributions are generated i.i.d. as S(i) ~ Bern(p s ), N(i) ~ Bern(p„), N z (i) ~ Bern(p Mi ). 
(All pk& satisfy pk € [0,0.5] for k = {s,n,n z }.) In this section, we use the following notation for the binary convolution 

p®q = p{l- q) + q(l-p). 
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with 



1 ) State cancelation scheme: To cancel the state from the channel, we send 

X(i) = U(i)®S(i), (13) 

where U(i) ~ Bern(p u ) and the codewords U n carry a description of the state sequence S" . This way, we achieve the following 
inner-bound. 

Corollary 11: The state cancelation scheme, which sends Bern(p„) distributed signal XORed with state sequence at each 
time instant, achieves the set of (R a , Ri) pairs denoted by the region 7Z SC , where 

K sc = Convex Hull i (J (R a ( Pu ) , R t (p u ) ) I C C, 

[p«6[0,0.5],p„®p,<0.5 J 

RaijPu) < min{lf(p s ), H(p u ®p n ) - H(p n )} 

RliPu) > H(p u ®p nz ) - H(p n J. 

Proof: Achievability follows from Proposition [3] ■ 

2) Optimal differential amplification rate: 

Corollary 12: If p n < p n , and H{p s ) > 1 — H(p n ) for a binary model the optimal amplification and leakage rate difference 
is given by 

C d = H(p nz )-H(p n ). 

Proof: From Proposition [9] we obtain the following. If p n < p nz , any given (R a , Ri) € C satisfies 

R a -Ri< H(p n _) - H( Pn ) + max {H{X S © N) - H(X ®S® N z )} . (14) 

p{x\s) 

Note that, this upper-bound can be evaluated by observing 

max {H [X © S © N) - H(X © S © N z )} 

p(x\s) 

= max {H{X®S®N)-H(X®S®N®N;)} 

p(x\s) 

< max {H(X © S © N) - H (X ® S ® N ® N* \N*)} 

p{x\s) 

= 0, (15) 

where the equality is due to the channel degradedness condition with appropriate noise term N* independent of N such that 
© N* = N z , and the inequality is due to the fact that conditioning does not increase the entropy. Using this we observe 
that the outer-bound is maximized with a choice of p{x) = 0.5, which evaluates to 

Ra-Ri<H( Pn J-H(p n ). (16) 

This expression is achieved by Corollary QT| when we choose p(u) = 0.5, if H(p s ) > 1 — H(p n ). 



C. Memory with defective cells model 

We consider the model of information transmission over write-once memory device with stuck-at defective cells |34| . l35l . 
In this channel model, each memory cell corresponds to a channel state instant with cardinality |<S>| = 3, where the binary 
channel output is determined from the binary channel input and the channel state as: 



p(y = 


0\x, 


s = 0) 


= 1 


p(y = 


l\x, 


S = l) 


= 1 


p(y = 


x\x, 


8 = 2) 


= 1, 



where Pr{5 = 0} = p is the probability that the channel is stuck at 0, PrlS* = 1} = q is the probability that the channel is 
stuck at 1, and Pr{S = 2} = r is the probability of having a good channel where y = x with p + q + r = 1. We consider a 
binary symmetric channel (BSC) from Y to Z, where 



Z = X © N, 

with N ~ Bern(n) for some n E [0,0.5]. This corresponds to a degraded DMC model. (See Fig. [2]) 



(18) 
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S(i) = w.p. p S(i) = 1 w.p. q S(i) = 2 w.p. r 



~^fO 




— ^0 



X(i) / Y(i) X{i) V Y{i) X(i) Y{i) 
1 / 1 1 — ^1 1 — =»-l 

y(<) ^ z(i) 



<+> 



iV(i) 

Fig. 2. Channel model of memory with defective cells, p = Pr{S = 0} (probability of being stuck at 0), q = Pr{S = 1} = q (probability of being stuck at 
1), r = Pr{S = 2} (probability of being in a noiseless state), and N ~ Bern(n), where n £ [0, 0.5] is the cross over probability of the BSC from Y to Z. 



We present numerical results for this channel model with three regions: Un-coded region, coded region, and an outer-bound 
region. The un-coded region is obtained by setting U = in Proposition [T] where we have the set of (R a , Ri) pairs satisfying 

R a < I(S;Y) (19) 
Ri > I(S;Z) (20) 

over all possible p(x\s). For the coded region, we simulate a sub-region of the one given in Proposition [3] where we set U = Y 
and achieve the set of (R a ,R[) pairs satisfying 

R a < mm{H(S),H(Y)} (21) 
R t > I(Y,S;Z)=H(Z)-H(N) (22) 

over all possible p(x\s). For converse arguments, we consider the outer-bound region given by the set of (R a ,Ri) pairs 
satisfying 

R a < mm{H(S),I(X,S;Y)=H(Y)} (23) 

Ri > I{S\Z) (24) 

over all possible p(x\s). This outer-bound region follows from Proposition [8] We evaluate the regions above in terms of the 
channel parameters as follows. Let Pr{X = 1} = a. Then, 

H(S) = H(p,q,r), (25) 

H(Y\S) = rH{a) (26) 

H{Y) = H(q + ra) (27) 

H(Z\S) = (p + q)H(n) + rH{a®n) (28) 

H(Z) = H((q + ra)<E)n), (29) 

where H (■,-,■) is the ternary entropy function, H(-) is the binary entropy function, and ® is the binary convolution given by 
p <8> q = p(l — q) + q(l — p). The numerical results are given in Fig. [3] The regions are truncated with i?; < H(S) as any 
Ri > H(S) is trivially achievable. We note that, the coded region is potentially larger than its un-coded counterparts even 
when we only compute a subset of the coded achievable region. This shows the enhancement provided by sending a refinement 
of the state sequence over the channel. 



Consider the channels given by 



IV. Gaussian Scenario 

Y{i) = X(i) + S(i) + N(i) 

Z(i) = X(i) + S{i) + N z {i), (30) 

where the state and noise distributions are generated i.i.d. as S(i) ~ 7V(0, a^), N(i) ~ 7V(0, <r^), N z (i) ~ Af(0, af l _ ), and the 
cost constraint on the channel input is given by c(x) = x 2 and C = P, i.e., 

n 

-^E{|XW| 2 }<P. (31) 

(See Fig. S|) 



n . 
i— l 
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R g vs. R, for p=1/3, q=1/3, r=1/3, n=0.1 R a vs. R, for p=1/12, q=1/12, r=5/6, n=0.1 
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Fig. 3. Simulation results for memory with defective cells model. 



A. An inner bound for C using an un-coded scheme 

The inner bound is based on sending an amplified version of S together with some additional Gaussian noise. This un-coded 
signal is constructed as follows. 



X{i) = P ^S(l) + y/(l- (?)(T x V(i), 



(32) 



where V(i) ~ Af(0, 1) independent of S(i), p € [—1, 1], and a 2 < P. Here, p 2 is the fraction of the power allocated to S(i). 
This scheme achieves the following region. 

Theorem 13: The un-coded scheme, which forwards S(i) at each time step together with some i.i.d. Gaussian noise as given 
in (l32l , achieves the set of (R a , Ri) pairs denoted by the region ~]Z m , where 

^un-coded = Conyex Hul j I (J R ^ 

[pe[-l,i],^e[o,P] 

with 

n i \ 1 , f, , a l + + p 2 a 2 x 
Ra(p,<T x ) = ~ log 1 + 2 , n 

The expressions above are obtained by evaluating R a = I(S; Y) and Ri = I(S; Z) on account of uncoded transmission in 
12). 

Examples: 

• If P > a 2 , one can set X = —S and achieve the pair 

(Ra =0,Ri =0). 

• Another trivial point is obtained by setting X = 0, which achieves 



5. Outer-bounds on C 

Corollary 14: Let p denote the correlation coefficient between X and S. The set of all achievable rate pairs (R a , Ri), satisfy 



10 




Fig. 4. The channel model for the Gaussian setting. S(i) ~ Af(0, a 2 s ), N(i) ~ J\f(0, a 2 ), and N z (i) ~ JV(0, o£ ). 



Ra < ltogfl+ g ' +g3 -t W ' 



2 



2 "V <+^(l~P 2 ) 

for -1 < p < 1 and a 2 x < P. 

Proof: Using Proposition [9] we have 

R a < I(X, S; Y) = h(Y) - h(Y\X, S) = h(Y) - h(N) < 1 log (l + ^ + 2f> °f x - + . (33) 

Using Proposition [9] the linear estimate S{Z) = g^-fj and the fact the conditioning reduces entropy, we get 

Ri > I(S; Z, U) > 7(5; Z) = h(S) - h(S\Z) = h(S) - h(S - S{Z)\Z) > h(S) - h(S - S{Z)). (34) 
Since the entropy maximizing distribution for a given second moment is a Gaussian, we have 

h(S-S(Z)) < il 0g 2vre ( - ga+a ^ <r . +pae 

V 1+ <+^(i-p 2 ) 



fl»>^lo 8 fl+ g '+ 2 ^ +P ,f' ). (36) 



leading to 

■ 

Corollary 15: Let p denote the correlation coefficient between X and S. If < v\ , then the set of all achievable rate 
pairs (R a ,Ri) satisfy 

«.-*< 5 v»(i + ^ )- s *(i + ^ 

for -1 < p < 1 and a 2 x < P. 

Proof: By Proposition [9] we have 

R a -Ri<I{X,S;Y\Z). (37) 
Without loss of generality, we consider N z = N + N' z with a\ = + a^, where N' z is independent of N. Noting that, 

I(X, S; Y\Z) = h(Y\Z) - h(Y\X, S, Z) = h(Y\Z) - h(N\N z ), (38) 
we upper bound h(Y\Z) using the following. Consider two zero-mean correlated random variables A and B. 

h(A\B) ( = } h(A-A(B)\B) 

< h(A — A(B)) (39) 
(*>) 1 

< -log(2^ e( 7 e 2 ), 

where in (a) we used A(B) as the estimate of A given B, and (b) follows by defining the estimation error variance a\ = 



E 



(A - A(B)f 



and the fact that Gaussian distribution maximizes entropy given the variance. We then upper bound the 



optimal estimator error variance by the linear MMSE variance. Therefore, 



h{A\B) < 1 log Une I var(A) - ^f]^ J J • (40) 
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Using the above, we obtain 



(a 2 + 2pa s a x +a 2 x + a 2 l ) 2 
ti a - tii S 77 log [ 27re [ o s + Lpo s o x + a x + a n ^ 



T 2 



™o 1 1 - n 

2, \ \ a, 

1 lQg L + <^ + 2 P ^ x+ al \ _ 1 bg / + ai+^+ai ^ R) 



This completes the proof. 



C. Comparison of inner and outer bounds for the degraded Gaussian channel 

We now compare the uncoded scheme and the outer bound presented above. In particular, we show that the uncoded 
transmission scheme achieves certain corner points of the amplification-masking region and that the gap between the inner and 
outer bounds on the region is within 1/2 bit for certain channel parameters. We also show that the uncoded scheme achieves 
the optimal difference R a — i£j . 

1) Characterization of the gap between achievable and converse regions: We show that given any point (R a ,Ri) in the 
converse region corresponding to a given (p,a x ), uncoded transmission achieves within 1/2 bit of the converse region under 
certain conditions on channel parameters. In particular, for any given R a , uncoded transmission achieves that R a and within 
1/2 bit of the bound on Ri if < 1. Similarly for any given Ri, uncoded transmission achieves the given Ri and within 

1/2 bit of the bound on R a if < 1. We prove these as follows. Using Corollary dT4b . any point in the outer bound region 
is described as 

^ = ^bg(l+ ^ + 05 + W * ) (42) 

for — 1 < p < 1 and a 2 < P. Now let us show that uncoded transmission achieves any Ri in the region above and the gap from 
R a as above is within 1/2 bit. Let the uncoded scheme be designed such that Xj = ^pSi + V\, where Vi ~ A/"(0, cr 2 (l — p 2 )) 

and independent of Si. Now, by < f33T > and (1331 this input achieves a leakage, I(S; Z) = | log ^1 + a S ^ P +*^ P ~p°)° ) w ^ ^ a 

given by I(S; Y) = i log ( 1 + as ^f + a Ji nzrjpj 2 ) > which implies the gap is given by 



ift = -bg 1+ s 2 r \ . r ' J (43) 

2 V < + cr ^( 1 -p) 



for -V < 1. Now, in order to prove the other claim, that uncoded achieves any given R a and the gap with Ri is within 1/2 



bit, we proceed as follows. Given R a = ^ log ^1 + cr s+ cr x+^P< T ' cr ^ j ; we achieve this by choosing an uncoded scheme such 

that Xi = %LSi if p > or Xi = -^Si if p < 0, and 

2 P 2 
°V + 2-;— rcr s cr x ' = cr + 2pa s a x , (45) 

|PI 

where < a x i < \[P. By the intermediate value theorem for continuous functions, it is clear that there exists a x i < \[P such 
that the condition above is satisfied. Further, the uncoded scheme achieves the desired R a . The scheme achieves an Ri given 

1 / cr 2 +(T 2 ,+2 T ^cr s (T x , \ 

by ^ log I 1 H x ai p| 1 leading to a gap 




<ilog2 = i (46) 



when -4— < 1. 
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Fig. 5. Simulation results for the Gaussian scenario. 



2) Differential amplification capacity: Note that the un-coded transmission achieves the maximum R a — Ri. The upper 
bound on R a — Ri in (TT3T > is maximized for a\ = P and p = 1. Thus, this maximum difference between R a and Ri is 
achieved by un-coded transmission corresponding to X = ^jr-S in Theorem Qj] and is given by 

1 1 I A j. + ^ 




C d = -log|l+ vs I ' ) - - log [ 1 + - s _ 2 ; ) (47) 



3) Corner points of the trade-off region: Consider the corner points of the amplification-masking region. Inspecting (f33), we 
observe that the point in the outer bound region corresponding to maximum amplification is given by p = 1. Clearly, from ( f44b 
and (1461) . we see that the gap is zero for p=l. Similarly, consider the point corresponding to minimum leakage Ri in the weak 
and moderate interference regimes as in l30l . These points again correspond to p = — 1 and we have I(X,S;Y) = I(S; Y) 
and I(X, S; Z) = I(S; Z), leading to the gap being zero. This is also verified by setting p = — 1 in d44l i and (06). 

4) Numerical results: We compare the un-coded region with an outer-bound region (in Proposition [141 in Fig. [5] The first 
case corresponds to a degraded scenario, where the gap between the regions is fairly small as expected from the analysis given 
above. However, for the reversely degraded scenario with larger power constraint P compared to the state power a\, the gap is 
larger. In Fig. |6l we plot the differential amplification capacity for a degraded channel (a^ = 1, = 5) for a range of power 
constraints P and different values of erf. Note that the differential amplification capacity saturates in the high SNR regime, 
and the effect of encoder in increasing Cd is decreasing as the power of the additive state increases. 



V. Conclusion 

We study the problem of state amplification under the masking constraints, where the encoder (with the knowledge of 
non-causal state S n ) facilitates the amplification rate (-^I(S n ;Y n )) at Bob (observing Y n ) while minimizing the leakage rate 
(i/(5'™; Z n )) as much as possible at Eve (observing Z n ). Our coding schemes are based on indexing the state sequence 
and sending one of the indices over the channel to Bob. The achievable region corresponding to this strategy is derived by 
calculating bounds on amplification and masking rates. We also show that for the input distributions enabling Bob to be a 
"stronger" receiver than Eve, the index of the state can be sent securely over the channel. This secure refinement approach 
is shown to lead to non-trivial achievable regions. We also provided outer bounds, using which we showed that the scheme 
without secure refinement achieves the optimal R a — Ri over the region in the reversely degraded DMCs, the degraded binary 
channels, and Gaussian channels. For the degraded Gaussian model, we also characterized the optimal corner points, and the 
gap between the outer bound and achievable regions. 

Several interesting problems can be considered as future directions. First, the channel cost may be introduced for the DMC 
model as well, and the cost may have some dependence on the state sequence or vary according to a stochastic model. 
Second, causal channel state knowledge can be considered. In addition, one can also consider sending messages to receivers in 
addition to the task of state amplification and masking. Our current focus is on such extensions. Also, the coded state sequence 
setting f34l (a scenario that is more relevant to the cognitive radio type systems, where the primary signal carrying a message 
corresponds to the channel state sequence that is non-causally known at the cognitive encoder) may also be considered. 
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Fig. 6. Differential amplification capacity C'd vs. power P (dB). The dashed curve with diamond markers correspond to the same scenario given in the 
degraded setting of Fig. \5\ (<rj = 10) for different power levels. 



Appendix A 
Proof of Proposition!]] 

Proof: Fix p(u,x\s), and consider s", the state sequence of the channel that is non-causally known at the encoder. We 

n 

generate 2 nRu codewords denoted by u n (w u ) with w u <E {1, • • • , 2 nRu }, each distributed according to Yl p( u i)- 

i=l 

The encoder chooses a u n (k) such that (u n (k),s n ) <E TJ 1 . (e-typical sets are denoted by T", and standard definition and 
properties of typical sets are used throughout the text |36l .) If no such codeword exists, an arbitrary sequence is picked. The 

n 

encoder sends x n generated by Y[ p(xi\ui(k),Si). 

?:=i 

We now derive an achievable amplification rate with this scheme. We consider the following. 

l -I(S n ]Y n ) ( = } -I(S n ;Y n \£ 1 )(l-PT{S?}) + -I(S n ]Y n \S?)Pi{S?} (48) 
n n n 

I(S n ;Y n \£ 1 )(l--Pi{£?}) (49) 
Pr{£ c 1 }(H(S) + e 1 ) (50) 

)(1 - Pri^l^}) + -Ii^-Y^E^xiE^} 

n 

fei) (51) 
I(S n ;Y n \£ 1 ,S 2 ) - (Pr{f 1 c }+Pr{f 2 c |f 1 })( J ff(5) + ei) (52) 

I(S n ;Y n ,U n \£ u £ 2 ) - (Pr{£f> + Pr{£ 2 c |£ 1 })(ff(S) +ei) (53) 

a 

> (H(S)-e 1 )-(H(S\Y,U) + e 2 )-(Pr{£n + Pr{£l\£ 1 })(H(S) + e 1 ) (54) 

( l ] I(S;Y, U)-€! (55) 

where in (a) £ x is the event that S n is a typical sequence, (b) follows as ±I{S n \Y n \£x) < ±H(S n \£i) < H(S) + e x 
as the number of typical S n sequences are bounded above by 2 n ^ H ^ s ' +£l ' ) with e\ — > as n oo, in (c) £ 2 is the 
event that U" is decoded given Y n , (d) is similar to (b), (e) follows as H(S n \£±) is lower bounded by n(H(S) — e±) and 
H(S n \Y n , U n , £x,£ 2 ) is upper bounded by n(H(S\Y, U) + e 2 ) as U n , S n , Y n are jointly typical, with e 2 -> as n -> oo, in 
(f) we define h 4 (Pr{£f> + Pr{£||£ + e x ) + ei + e 2 . 



(a) 


1 




— ^ 

n 




1 


> 


— ^ 






(M 


1 


> 


— j 




n 


(c) 


1 




— j 
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(d) 
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— j 








1 




j 

n 
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Here, as n — > oo, Pr{£f} — ^ 0, and Pr{£||£i} ~ ^ when we select 

R u = I(U;S) + e 3 (56) 
R u < I(U-Y), (57) 

where the first condition makes encoding error arbitrarily small (also known as the mutual covering lemma), and the second 
one allows obtaining U n jointly typical with Y n given that there is no encoding error, i.e., U n ,S n are jointly typical and 
generates Y n . This shows that ±I(S n ; Y n ) > I(S; Y, U) - ei > R a - h, i.e., any R a < I(S; Y, U) is achievable. 
We now derive the achievable leakage rate expression for this scheme. 

-US"; Z n ) = -I(S n ; Z n \£ 0(1 - Pr{£?}) + -I(S n ; Z n \£^)Pi{£^} (58) 
n n n 

< i/(S ra ; + iI(S)Pr{££} (59) 

n 

< -I(S n - : Z n ,U n \£ 1 ) + H(S)Pr{£?} (60) 

n 

< (H(S)+e 1 )-(H(S\Z,U)-e 2 )+H(S)Pi{£ c 1 } (61) 



(d) 



I(S; Z, U) + e 2 (62) 



where in (a) £\ is the event that S n is a typical sequence, in (b) we included the U n chosen at the encoder, (c) follows as 
H(S n \£i) is upper bounded by n(H(S) + e x ) and H(S n \Z n , U n ,£i) is lower bounded by n(H(S\Z, U) - e 2 ), which can 
be shown by using the event that U n ,S n ,Z n are jointly typical w.h.p., and in (d) we define i-2 = e\ + £2 + -ff(5)Pr{ff}. 
Noting that e 2 -> as n -> 00 concludes the proof as i/(5 n ; Z n ) < 1(5; Z, [/) + e 2 < i?/ + e 2 , i.e., any i? ; > 7(5; Z, C7) is 
achievable. Along the same lines, one can similarly obtain that any Ri > I(U, S; Z) is achievable. (Also given in the proof of 
Proposition [3]) ■ 

Appendix B 
Proof of Proposition^ 

Proof: Fix p(u,x\s), and consider s n , the state sequence of the channel that is non-causally known at the encoder. We 
generate 2 n ^ Ru+R ^ codewords denoted by U n (w u , w' u ) each distributed according to Yi p( u i), where w u G {1, • ■ ■ , 2 nR "} 

i=l 

and w' u G {1, ■ ■ ■ , 2 nR **}. We also list all the typical S n sequences with two indices S n (w u , w r ). 

For the given s n sequence, if it is a typical sequence the encoder identify it as s n (k,l), otherwise arbitrary indices are 
chosen. Encoder then finds the index m € {1, • • • ,2 ni? «}, such that u n (k,m) and s n (k 1 l) are jointly typical. If no such 

n 

codeword exists, an arbitrary sequence is picked. The encoder sends x n generated by Y[ p{xi\ui(k,m),Si(k,l)). 

i=l 

Denote £\ to be the event that S" is a typical sequence, and £2 is the event that U n is decoded given Y n using joint 
typicality decoder. Here, as n —> 00, Pr{£f} — > 0, and Pr{£||£i} — > when we select 

K = HU;S)+e 1 (63) 
Ru+K < I(U;Y), (64) 

where the first condition makes encoding error arbitrarily small (see ifTHl ), and the second one allows decoding U n (K,M) 
using joint typicality with Y n given that there is no encoding error, i.e., U n (K, M), S n (K, L) are jointly typical and generates 
Y n . We set 

R u = min{/(f/; Y) - I(U; S) - e u H(S\U, Y) — ei} (65) 

with some ei — > as n — >• 00. 

We derive the achievable amplification rate as follows. 

-I(S n ; Y n ) { ^ -I(S n ; Y n \£ 0(1 - Pr{£f }) + -I(S n ; Y n \£?)Pi{£f} (66) 
n n n 

n ;Y n \£ 1 )(l--Pr{£n) (67) 



(a) 


1 




n 




1 


> 






n 


(b) 


1 


> 






n 


(c) 


1 




n 



I(S n ; Y n \£ x ) - ?x{£t}{H{S) + e 2 ) (68) 

7(^;y™|£ 1 ,f 2 )(l-Pr{£ 2 c |£: 1 }) + i/(^;y"|£ 1 ,£ 2 c )Pr{f 2 c |f 1 } 
Pr{£ 1 c }(^) + £ 2 ) (69) 
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( > } ll(S n ;Y n \£ 1 ,£ 2 )-(Pr{£ c 1 }+Pr{£l\£i})(H(S) + e 2 ) (70) 
n 

= -I(S n (K,L);Y n 7 U n (K,M)\£ l7 £ 2 ) 
n 

- (Pr{£ f} + Pr{£ 2 c |£ 1 })( J ff(5) + e a ) (71) 
= -iT(S"(X, L)|f i, £ 2 ) - M), £ 1; £ 2 ) 

71 71 

+ -H{Y n \U n {K,M),£ u £ 2 ) 
n 

--H(Y n \S n (K,L),U n (K,M),£ 1 ,£ 2 ) 
n 

- (Pr{£f} + Pr{£ 2 c |£ 1 })(i/(5) + e 2 ) (72) 

> i? u + i? r - R r + I(U; S) - ei + (#(F|C7) - e 2 ) - 5) + e 3 ) 

- (Pi-{£ n + Pr{£ 2 c |£i })(#(#) + e a ) (73) 
min{if(5), /(£/, 5; F)} - ei (74) 

where in (a) we used the event £ u (b) follows as ^I(S n ;Y n \£ 1 ) < ±H(S n \£i) < H(S) + e 2 as the number of typical S n 
sequences are bounded above by 2 ra ( ff ( s ' +C2 ' with e 2 — > as n — ► oo, in (c) we used the event £ 2 , (d) is similar to (b), (e) 
follows as 

H{S n (K,L)\£^£ 2 ) = n(R u + R r ) (75) 

H(S n (K, L)\U n (K, M), £i,£ 2 ) < n{R r - I(U; S) + Cl ) (76) 

ff(r"|[/"(if,M), > n(ff(y|l7) - e 2 ) (77) 

(y " 1 5" (if, L) , U n (K, M),£i,£ 2 ) < n(H(Y\S,U) + e 3 ), (78) 

where e 2 , 63 — > as n — > 00. (We show dTol l in Lemma [TBI and d77b in Lemma [TTl both are given at the end of this proof. The 
last bound can be shown by using the event that (U n (K, M), S n (K, L),Y n ) is jointly typical w.h.p. as each Y% is generated 
from Si(k,l),Ui(k,m) with the associated p(y\s,u).) In (f), we define ei = (Pr{ff} + Pi{£i\£!}){H(S) + e 2 ) + £l + e 2 + e 3 , 
where readily have ei — > as n — > 00. 

This shows that ±I(S n ;Y n ) > mm{H(S), I(U, S; Y)} - h > R a ~h, i.e., any 

R a <mm{H(S),I(U,S;Y)} (79) 

is achievable. 
We bound ±I(S n ; Z n ) as follows. 

-I(S n ; Z n ) = -I(S n ; Z n \£ x ){\ - Pr{£?}) + -J(S"; Z n \£{)Vx{£{} (80) 

71 71 71 

< -I(S n ;Z n \£ x ) + H{S)Pr{£l} (81) 

71 

< -7(C/"(X, M), S n (K, L)\ Z n \£{) + H(S)Pi{£^} (82) 

71 

< (ff (Z) + ci) - (H(Z\U, S) - ea ) + H(5)Pr{f f} (83) 



/([/, 5; Z) + e 2 (84) 



where in (a) £\ is the event that S n is a typical sequence, in (b) we included the U n (K,M) chosen at the encoder 
which observes the typical sequence S n (K,L) (c) follows as H(Z n \£i) is upper bounded by n(H(Z) + ei) and the term 
H(Z n \U n (K, M), S n (K, L),£{) is lower bounded by n(H(Z\U,S) - e 2 ), which can be shown by using the event that 
U n (K, M), S n (K, L), Z n are jointly typical w.h.p. for any K = w u . (Note that this implies that Z n is a typical sequence 
w.h.p. as (U n (K,M),S n (K,L)) is typical.) In (d), we define e 2 = e x + £2 + H(S)Pr{££}. Noting that i 2 -4 as n -> 00 
concludes the proof as ±I(S n ; Z n ) < I(U, S; Z) + e 2 < R t + e 2 , i.e., any R t > I(U, S; Z) is achievable. 
Lemma 16: For d76b , we can obtain the bound using the following argument. 
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H(S n (K,L)\U n (K,M),£ 1 ,£ 2 ) = H{S n (K 7 L)\K 7 U n {K 7 M) 7 £ l7 £ 2 ) (85) 

= H{S n {K 7 L)\K 7 £ l7 £ 2 )-I{S n (K 7 L) 7 U n (K 7 M)\K 7 £ l7 £ 2 ) (86) 
= nRr- Pi{K = w u }I(S n (K,L);U n {K,M)\K = w u ,£i,£ 2 )(Sl) 



nR r - Pl i K = m ") f H {U n (K 7 M)\K = w u , £ x ,£ 2 ) 



- H(U n (K 7 M)\K = w U7 S n {K 7 L) 7 £ l7 £ 2 )^ (88) 

(a) ^ 

< nR r - ^ Pl i K = w u\ n {I{U\ S) - e x ) (89) 

tu«e{i,- ,2« H »} 

= n(i? r -/([/; 5) + £l ) (90) 

where (a) holds as H(U n (K 7 M)\K = w U7 S n (K, L) 7 £\ 7 £ 2 ) = 0, as M is determined when there is no encoding error, and 
H(U n (K 7 M)\ K ~ w U7 £i,£ 2 ) > n(I(U;S) — ei) with t\ — > as n —> oo, which follows as each U n (w U7 m) is a typical 
sequence given fi and £2, where each codeword is approximately uniformly distributed; and the number of U n (w U7 M) 
codewords is 2 n ^^ U ' S ^ +ei \ 

Lemma 17: Note that the event £ 2 implies that Y n is jointly typical with the decoded sequence U n (K 7 M). Therefore, it 
follows that 

H(Y n \U n (K,M) 7 £ l7 £ 2 ) > n(H(Y\U) - e 2 ), (91) 

for some e 2 — > as n — > 00. 



Appendix C 
Proof of Proposition^ 

Proof: Consider a p(u 7 x\s) satisfying I(U ; Y) > I(U ; Z). We divide the proof into two cases. 
(A) I(U;Z) > I(U;S): We use the same codebook given in Proposition [3] The amplification rate analysis follows from 
Proposition [3] 

We first consider the following bound for the leakage rate. 

H(W u \Z n ) = H(W U7 WiZ n )-H(W' u \W U7 Z n )-H(Z n ) (92) 
= H{U n 7 Z n ) + H(W U7 W' u \U n 7 Z n )-H{W' u \W U7 Z n )-H{Z n ) (93) 

> n(R u +I(U;S)-I{U;Z)-e i ), (94) 

where (a) follows as H{W! a \W U7 Z n ) < ne 2 due to the fact that, given W u , Z n can decode W' u from the codebook U n (W U7 W^), 
H{W U7 Wi\U n 7 Z n ) > 0, and H(U n \Z n ) = H(U n )- I(U n ; Z n ) = n(R u + R' u ) - I(U n ; Z n ) > n{R u + R' u -I{U- 7 Z)-e i ) = 
n(R u + I(U; S) - I(U; Z) - e 3 + ei) due to R' u = I(U; S) + ei and bounding I(U n ; Z") < n{I(U; Z) + e 3 ). We combined 
efc terms within some 64 — > as n — > 00. 
Using this, we can get the following 

I(W U ; Z n ) = H(W U ) - H(W u \Z n ) < n(mm{R U7 I(U 7 Z) - I(U; S)} + e 4 ), (95) 

where the first bound in minimum expression is the trivial upper bound. 

Then, we bound the leakage rate using the event £\ : The event that S n is typical. (We suppress all diminishing terms within 
some 6fc — > as n — > 00.) 

I(S n ;Z n ) < I(S n (W u ,W r );Z n \£ 1 ) + ne 5 (96) 
= I(W U7 S n (W U7 W r );Z n \£ 1 ) + ne 5 (97) 
= I(W U ; Z n \£t) + H(S n (W U7 W r )\W u ,£i) - H(S n (W U7 W r )\Z n 7 W U7 £ x ) + ne 5 (98) 

< n(^mm{R u ,I{U 7 Z)-I{U 7 S)} + H{S)-R u -H{S\Z 7 U) + R u + e^ (99) 

= n{I(S; Z,U)+min{R u ,I{U;Z) - I(U; S)} + e 6 ) (100) 
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where (a) follows from three observations: 

1) We have I(W U ; Z n ) = Pr{£ 1 }/(W„; Z n \£ i) + Pi{£f}I(W u ; Z n \£{), which implies I(W U ; Z n \£ x ) < I(W U ; Z n ) + ne 7 , 
where the right hand side is upper bounded by ( 195) . 

2) H(S n (W u ,W r )\W u ,£ 1 ) = n(H(S) - R u ), and 

3) We observe 

H(S n (Wu,W r )\Z n ,Wu,£i) > H(S n (Wu,Wr)\Z n ,U n (W u , W' u ),£i,£ 2 ) (101) 

= H(S n (W u ,W r )\U n (W u ,W^,£x,£ 2 ) - H(Z n (W u ,W r )\U n (W u ,Wi),£ 1 ,£ 2 ) 

+ H(Z n \S n (W u , W r ), U n (W u , W( l ),S 1 ,£ 2 ) (102) 
> n(R r -I(U;S)-H(Z\U)+H(Z\U,S)-e 8 ) (103) 
= n(H(S\Z,U)-R u -e 8 ), (104) 

where we condition the entropy with the codeword chosen at the encoder together with the event £ 2 (defined as in the previous 
proof, but here with Z n ) in the first inequality, and the second inequality follows from the analysis given in the proof of 
Proposition [3] Using the same typicality arguments given for d77l i and d781 l. we obtain 

H(Z n (Wu,W r )\U n {W u ,Wi),£i,£ 2 )<n(H(Z\U) + e 9 ) (105) 

and 

H(Z n \S n (W u ,W r ), U n (W u , W' u ), £x,£ 2 ) > n(H(Z\S, U) - e 10 ), (106) 
and modifying the inequality in Lemma [T6l we obtain 

H(S n (W u ,W r )\U n (W u ,Wi),£ u £ 2 )>n(Rr-I(U;S)-e n ) (107) 

similar to the single letterization of d76l) . 
Therefore, the leakage rate 

Ri > I(S; Z, U) + min{7(C/; Z) - I(U; S),R U } (108) 

is achievable. 

(B) I(U; S) > I(U; Z): (Sketch of the proof) We modify the codebook given in Proposition We design U n (W u , W' u , W£) 
sequences where each index has the rate R U ,R' U , i?" respectively. We set R' u = I(U ; S) — I{U; Z), i?" = I(U; Z), and set 
the rate R u as in the Proposition [3] Here, given w u the encoder chooses w' u ,w'^ such that u n (w u ,w' u ,w") is jointly typical 
with s n (w u , w r ). 

Similar to the analysis above for obtaining (1951 1. by replacing W u with (W U ,W^), and W' u with VK" in the analysis given 
in d£3, we obtain H(W U , W' u \Z n ) > n{R u + R u , - e 12 ) and hence 

I(W u ,Wi;Z n )<ne 12 , (109) 

showing that I(W u ;Z n ) < ne\, and hence the message W u is secured. Then, the leakage analysis given in part (A) above 
follows, where, using (1109b . we obtain 

I(S n ;Z n )<n(I(S;Z,U) + e 13 ). (110) 

The amplification rate analysis follows from Proposition [3] The leakage rate expression follows from the analysis given in 
the proof of Proposition [3] (showing the achievability of leakage Ri > I(U, S; Z)), in addition to the analysis above. 



Appendix D 
Proof of Proposition[8] 

Proof: We have the following bound. 

I(S n ;Y n ) < I(X n ,S n ;Y n ) (111) 

(a) n 

< ^(X^SiM) (112) 

i=l 

( = } nI(X,S;Y), (113) 

where (a) is due to the memoryless channel p(yi\xi,Si) and the fact that conditioning does not increase the entropy, and (b) 
follows as each instant the channel is given by p(y\x, s). In addition, 

I(S n ;Y n ) < H{S n ) (114) 
= nH(S). (115) 
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We then bound Z n ). 

I(S n ;Z n ) = H(S n ) - H{S n \Z n ) (116) 

n 

= ^2 H(Si) — H(Si\S{~ 1 , Z n ) (117) 



*' = 1 



(a) 71 
i=l 



(119) 



(4) 

i=i 

nI(S;Z,U), (120) 

where (a) is due the fact that conditioning does not increase the entropy, in (b) we defined Ui = (S^~ , Zf +1 ). 
We now obtain another condition using the definition of U t = (Sj -1 , Z? +1 ). 

n 

< Y,I{Zb.x,Zi) (121) 

i=l 
n 

= Y. I ^~\Z^ l] Z l )-I{S{- 1 -Z l \Z^ +1 ) (122) 

1=1 

n 

( = } ^(St 1 , Z? +l] Zi) - I{Z? +1 ; SilSt 1 ) (123) 

i=l 
n 

= ^/(sr 1 ,^!;^)-!^- 1 ,^!;^) (124) 
i=i 

= n(I(U;Z)-I(U;S)), (125) 

where (a) follows by Csiszar's sum lemma. (We note the similarity of the analysis above with the converse result of the 
Gel'fand-Pinsker problem given in [37], where the indices of S and Z are reversed.) 

We combine the bounds above with the fact that any achievable (R a , Ri) for the given channel p(y, z\x, s) and p(s) should 
satisfy ±I(S n ; Y n ) > R a - e and ±I(S n ; Z n ) < R t + e. 

■ 

Appendix E 
Proof of Proposition^ 

Proof: Let V\ denote the set of p(u,x\s) satisfying I(U;Y) > I(U;S), and denote V2 denote the set of p(u, x\s) 
satisfying I(U;Z) > I(U;S). For the channel p(y,z\x,s) = p(y\x, s)p(z\y), any p e Vi also satisfies p e Vi. Therefore, 
using the Proposition [S] we have that if (R a ,Ri) is achievable, then (R a ,Ri) € IZ^, where 

K= (J ( R ^ R i) (126) 

satisfying 

R a < mm{H(S),I(X,S;Y)} (127) 

Ri > I(S;Z,U) (128) 

< I{U;Y) -I(U; S). (129) 

It remains to show R a — Ri bound. We argue as follows. 

n{R a -R{) = I(S n ;Y n )-I(S n ;Z n ) (130) 
= I{X n ,S n ;Y n )-I{X n ,S n ;Z n )-(I(X n ;Y n \S n )-I(X n ;Z n \S n )) (131) 

(a) 

< I(X n ,S n ;Y n )-I(X n ,S n ;Z n ) (132) 
( = } I(X n ,S n ;Y n \Z n ) (133) 
(«0 A 

< ^2l(Xi, Si;Yi\Zi) (134) 
i=i 

= nI(X,S;Y\Z), (135) 



19 



where (a) and (b) are due to the degradedness condition, and (c) follows from the memoryless property of the channel. The 
result then follows by taking the union over all joint distributions p(u,x\s). ■ 

Appendix F 
Proof of the converse for Theorem[Tq1 

Proof: We bound the rate difference as follows. 

n(Ra-Ri) < I(S n ;Y n )-I(S n ;Z n ) (136) 

n 

= ^/(5";r i |^- 1 )-/(5";Z,|ZlV 1 ) (137) 



i=i 



(«) 



i=l 

- [l(S n ; Zi\Y*-\ Z? +1 ) + 7(Y 1 i " 1 ; Z^Z^) - 7(y i i " 1 ; S")] (138) 

n 

Y,I(S n -,Y i \Yt\Z?+ x )-I{S n -,Z i \Yt\Z? +1 ) (139) 

i=l 

— Tl Q • V. I 1 7 n c«— 1 on \ , Tfoi—l on -V.\vi— 1 7B \ 

— ^ V *' il l J^i+l' ! ) T -< ^l ) *^i+l 5 *l 1 i^i+l) 

-I(Sn Zi\Yr\Z? +11 S\-\S? +l ) - I(S\-\S? +1 ; Z^Yf ,Z? +1 ) (140) 
< ^IiSiiYilUj-IiSnZilUi) (141) 

i=l 

( = } n[I(5;y|C/)-/(5;Z|C/)], (142) 
where, in (a), we used the equalities 

7(5"; YIY*- 1 ) + I(Z^ +1 ;Y\Yt\S n ) = 7(Zf +1 ; Y^Y/" 1 ) + 1(5"; Y^" 1 , (143) 

and 

7(S"; + 7(Y 1 i " 1 ; S») = 7(Y 1 i " 1 ; Zi\Z? +1 ) + I(S n ; Z^^Y^ 1 ); (144) 

in (b), we used the Csiszar's sum lemma ll27l (and a conditional form of it) to obtain the equalities 

n n 

Y^m+i^Yr 1 ) ='£l(Yt 1 ;Z i \Z? +1 ) (145) 

i=l i=l 

and 

n n 

i=i i=i 

in (c), we define Ui = (Y^~ , Z™ +1 , 5 1 } -1 , S™ +1 ); and in (d), we obtain the single-letter expression (by defining U = (Ui,i), 
etc., see, e.g., 1361 ). Note that, with the definition of Ui in (c), X, is generated from S n , and hence from (Ui, Si). In addition, 
given (Xi,Si), Zi is independent of (Ui,Si). Thus, (U,S) — > (X,S) — > Z forms a Markov chain, and the upper bound is 
given by 

Ra-Ri < max I(S;Y\U)-I(S;Z\U) (147) 

p(u,x\s) s.t (U,S)->( X ,S)-*Z 

max I(S;Y\U = u*) - I(S;Z\U = u*) (148) 

p(x\u* ,s) , u* £IA 

= max 7(5; y) - 7(5; Z), (149) 

p(a|s) 

where the equalities follow due to the following: First, the conditional mutual information expression is maximized with 
a particular input it* (as randomizing over different u values will not increase the sum ^2(I(S;Y\U = u) — I(S;Z\U = 

u 

u))Pr{U = it})) and a probability distribution p*(x\u* , s). Second, the optimal p*(x\u* , s) will correspond to a p(x\s). Thus, 
the converse result can be stated over input distributions in the form p(x\s), thus matching the achievability result. ■ 
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